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PHYSICAL NEURAL NETWORK DESIGN 
INCORPORATING NANOTECHNOLOGY 

TECHNICAL FIELD 5 

The present invention generally relates to nanotechnol- 
ogy. The present invention also relates to neural networks 
and neural computing systems and methods thereof. The 
present invention also relates to physical neural networks, 
which may be constructed based on nanotechnology. The 10 
present invention also related to VLSI (Very Large Scale 
Integrated) analog neural network chips. The present inven- 
tion also relates to nanoconductors, such as nanotubes and 
nano wires. 

15 

BACKGROUND OF THE INVENTION 

Neural networks are computational systems that permit 
computers to essentially function in a manner analogous to 

that of the human brain. Neural networks do not utilize the nn 

20 

traditional digital model of manipulating O's and l's. 
Instead, neural networks create connections between pro- 
cessing elements, which are equivalent to neurons of a 
human brain. Neural networks are thus based on various 
electronic circuits that are modeled on human nerve cells „ 

25 

(i.e., neurons). Generally, a neural network is an 
information-processing network, which is inspired by the 
manner in which a human brain performs a particular task or 
function of interest. Computational or artificial neural net- 
works are thus inspired by biological neural systems. The 3Q 
elementary building block of biological neural systems is of 
course the neuron, the modifiable connections between the 
neurons, and the topology of the network. 

Biologically inspired artificial neural networks have 
opened up new possibilities to apply computation to areas 35 
that were previously thought to be the exclusive domain of 
human intelligence. Neural networks learn and remember in 
ways that resemble human processes. Areas that show the 
greatest promise for neural networks, such as pattern clas- 
sification tasks such as speech and image recognition, are 40 
areas where conventional computers and data-processing 
systems have had the greatest difficulty. 

In general, artificial neural networks are systems com- 
posed of many nonlinear computational elements operating 
in parallel and arranged in patterns reminiscent of biological 45 
neural nets. The computational elements, or nodes, are 
connected via variable weights that are typically adapted 
during use to improve performance. Thus, in solving a 
problem, neural net models can explore many competing 
hypothesis simultaneously using massively parallel nets 50 
composed of many computational elements connected by 
links with variable weights. In contrast, with conventional 
von Neumann computers, an algorithm must first be devel- 
oped manually, and a program of instructions written and 
executed sequentially. In some applications, this has proved 55 
extremely difficult. This makes conventional computers 
unsuitable for many real-time problems. A description and 
examples of artificial neural networks are disclosed in the 
publication entitled "Artificial Neural Networks 
Technology," by Dave Anderson and George McNeill, Aug. go 
10, 1992, a DACS (Data & Analysis Center for Software) 
State-of-the-Art Report under Contract Number F30602-89- 
C-0082, Rome Laboratory RL/C3C, Griffiss Air Force Base, 
New York. 

In a neural network, "neuron-like" nodes can output a 65 
signal based on the sum of their inputs, the output being the 
result of an activation function. In a neural network, there 
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exists a plurality of connections, which are electrically 
coupled among a plurality of neurons. The connections serve 
as communication bridges among of a plurality of neurons 
coupled thereto. A network of such neuron-like nodes has 
the ability to process information in a variety of useful ways. 
By adjusting the connection values between neurons in a 
network, one can match certain inputs with desired outputs. 

One does not program a neural network. Instead, one 
"teaches" a neural network by examples. Of course, there 
are many variations. For instance, some networks do not 
require examples and extract information directly from the 
input data. The two variations are thus called supervised and 
unsupervised learning. Neural networks are currently used 
in applications such as noise filtering, face and voice rec- 
ognition and pattern recognition. Neural networks can thus 
be utilized as an advanced mathematical technique for 
processing information. 

Neural networks that have been developed to date are 
largely software -based. A true neural network (e.g., the 
human brain) is massively parallel (and therefore very fast 
computationally) and very adaptable. For example, half of a 
human brain can suffer a lesion early in its development and 
not seriously affect its performance. Software simulations 
are slow because during the learning phase a standard 
computer must serially calculate connection strengths. 
When the networks get larger (and therefore more powerful 
and useful), the computational time becomes enormous. For 
example, networks with 10,000 connections can easily over- 
whelm a computer. In comparison, the human brain has 
about 100 billion neurons, each of which is connected to 
about 5,000 other neurons. On the other hand, if a network 
is trained to perform a specific task, perhaps taking many 
days or months to train, the final useful result can be etched 
onto a piece of silicon and also mass-produced. 

A number of software simulations of neural networks 
have been developed. Because software simulations are 
performed on conventional sequential computers, however, 
they do not take advantage of the inherent parallelism of 
neural network architectures. Consequently, they are rela- 
tively slow. One frequently used measurement of the speed 
of a neural network processor is the number of interconnec- 
tions it can perform per second. For example, the fastest 
software simulations available can perform up to about 18 
million interconnects per second. Such speeds, however, 
currently require expensive super computers to achieve. 
Even so, 18 million interconnects per second is still too slow 
to perform many classes of pattern classification tasks in real 
time. These include radar target classifications, sonar target 
classification, automatic speaker identification, automatic 
speech recognition and electro-cardiogram analysis, etc. 

The implementation of neural network systems has lagged 
somewhat behind their theoretical potential due to the dif- 
ficulties in building neural network hardware. This is pri- 
marily because of the large numbers of neurons and 
weighted connections required. The emulation of even of the 
simplest biological nervous systems would require neurons 
and connections numbering in the millions. Due to the 
difficulties in building such highly interconnected 
processors, the currently available neural network hardware 
systems have not approached this level of complexity. 
Another disadvantage of hardware systems is that they 
typically are often custom designed and built to implement 
one particular neural network architecture and are not easily, 
if at all, reconfigurable to implement different architectures. 
A true physical neural network chip, for example, has not yet 
been designed and successfully implemented. 

The problem with pure hardware implementation of a 
neural network with technology as it exists today, is the 
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inability to physically form a great number of connections 
and neurons. On-chip learning can exist, but the size of the 
network would be limited by digital processing methods and 
associated electronic circuitry. One of the difficulties in 
creating true physical neural networks lies in the highly 5 
complex manner in which a physical neural network must be 
designed and built. The present inventor believes that solu- 
tions to creating a true physical and artificial neural network 
lies in the use of nanotechnology and the implementation of 
analog variable connections. The term "Nanotechnology" 1Q 
generally refers to nanometer-scale manufacturing 
processes, materials and devices, as associated with, for 
example, nanometer-scale lithography and nanometer-scale 
information storage. Nanometer-scale components find util- 
ity in a wide variety of fields, particularly in the fabrication 15 
of microelectrical and microelectromechanical systems 
(commonly referred to as "MEMS"). Microelectrical nano- 
sized components include transistors, resistors, capacitors 
and other nano -integrated circuit components. MEMS 
devices include, for example, micro-sensors, micro- 2Q 
actuators, micro-instruments, micro-optics, and the like. 

In general, nanotechnology presents a solution to the 
problems faced in the rapid pace of computer chip design in 
recent years. According to Moore's law, the number of 
switches that can be produced on a computer chip has 25 
doubled every 18 months. Chips now can hold millions of 
transistors. However, it is becoming increasingly difficult to 
increase the number of elements on a chip using present 
technologies. At the present rate, in the next few years the 
theoretical limit of silicon based chips will be reached. 30 
Because the number of elements, which can be manufac- 
tured on a chip, determines the data storage and processing 
capabilities of microchips, new technologies are required 
which will allow for the development of higher performance 
chips. 35 

Present chip technology is also limiting when wires need 
to be crossed on a chip. For the most part, the design of a 
computer chip is limited to two dimensions. Each time a 
circuit must cross another circuit, another layer must be 
added to the chip. This increases the cost and decreases the 40 
speed of the resulting chip. A number of alternatives to 
standard silicon based complementary metal oxide semicon- 
ductor ("CMOS") devices have been proposed. The com- 
mon goal is to produce logic devices on a nanometer scale. 
Such dimensions are more commonly associated with mol- 45 
ecules than integrated circuits. 

Integrated circuits and electrical components thereof, 
which can be produced at a molecular and nanometer scale, 
include devices such as carbon nanotubes and nanowires, 
which essentially are nanoscale conductors 50 
("nanoconductors"). Nanocondcutors are tiny conductive 
tubes (i.e., hollow) or wires (i.e., solid) with a very small 
size scale (e.g., 1.0-100 nanometers in diameter and hun- 
dreds of microns in length). Their structure and fabrication 
have been widely reported and are well known in the art. 55 
Carbon nanotubes, for example, exhibit a unique atomic 
arrangement, and possess useful physical properties such as 
one-dimensional electrical behavior, quantum conductance, 
and ballistic electron transport. 

Carbon nanotubes are among the smallest dimensioned 60 
nanotube materials with a generally high aspect ratio and 
small diameter. High-quality single-walled carbon nano- 
tubes can be grown as randomly oriented, needle -like or 
spaghetti-like tangled tubules. They can be grown by a 
number of fabrication methods, including chemical vapor 65 
deposition (CVD), laser ablation or electric arc growth. 
Carbon nanotubes can be grown on a substrate by catalytic 
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decomposition of hydrocarbon containing precursors such 
as ethylene, methane, or benzene. Nucleation layers, such as 
thin coatings of Ni, Co, or Fe are often intentionally added 
onto the substrate surface in order to nucleate a multiplicity 
of isolated nanotubes. Carbon nanotubes can also be nucle- 
ated and grown on a substrate without a metal nucleating 
layer by using a precursor including one or more of these 
metal atoms. Semiconductor nanowires can be grown on 
substrates by similar processes. 

Attempts have been made to construct electronic devices 
utilizing nano-sized electrical devices and components. For 
example, a molecular wire crossbar memory is disclosed in 
U.S. Pat. No. 6,128,214 entitled "Molecular Wire Crossbar 
Memory" dated Oct. 3, 2000 to Kuekes et al. Kuekes et al 
disclose a memory device that is constructed from crossbar 
arrays of nanowires sandwiching molecules that act as on/off 
switches. The device is formed from a plurality of 
nanometer-scale devices, each device comprising a junction 
formed by a pair of crossed wires where one wire crosses 
another and at least one connector species connects the pair 
of crossed wires in the junction. The connector species 
comprises a bi-stable molecular switch. The junction forms 
either a resistor or a diode or an asymmetric non-linear 
resistor. The junction has a state that is capable of being 
altered by application of a first voltage and sensed by the 
application of a second, non-destructive voltage. A series of 
related patents attempts to cover everything from molecular 
logic to how to chemically assemble these devices. 

Such a molecular crossbar device has two general appli- 
cations. The notion of transistors built from nanotubes and 
relying on nanotube properties is being pursued. Second, 
two wires can be selectively brought to a certain voltage and 
the resulting electrostatic force attracts them. When they 
touch, the Van der Walls force keeps them in contact with 
each other and a "bit" is stored. The connections in this 
apparatus can therefore be utilized for a standard (i.e., binary 
and serial) computer. The inventors of such a device thus 
desire to coax a nanoconductor into a binary storage media 
or a transistor. As it turns out, such a device is easier to 
utilize as a storage device. 

The molecular wire crossbar memory device disclosed in 
Kuekes et al and related patents thereof simply comprise a 
digital storage medium that functions at a nano-sized level. 
Such a device, however, is not well-suited for non-linear and 
analog functions. Neural networks are non-linear in nature 
and naturally analog. A neural network is a very non-linear 
system, in that small changes to its input can create large 
changes in its output. To date, nanotechnology has not been 
applied to the creation of truly physical neural networks. 

Based on the foregoing, the present inventor believes that 
a physical neural network which incorporates nanotechnol- 
ogy is a solution to the problems encountered by prior art 
neural network solutions. In particular, the present inventor 
believes that a true physical neural network can be designed 
and constructed without relying on computer simulations for 
training, or relying on standard digital (binary) memory to 
store connections strengths. 

BRIEF SUMMARY OF THE INVENTION 

The following summary of the invention is provided to 
facilitate an understanding of some of the innovative fea- 
tures unique to the present invention, and is not intended to 
be a full description. A full appreciation of the various 
aspects of the invention can be gained by taking the entire 
specification, claims, drawings, and abstract as a whole. 

It is, therefore, one aspect of the present invention to 
provide a physical neural network. 
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It is therefore another aspect of the present to provide a 
physical neural network, which can be formed and imple- 
mented utilizing nanotechnology. 

It is still another aspect of the present invention to provide 
a physical neural network, which can be formed from a 5 
plurality of interconnected nanoconnections or nanoconnec- 
tors. 

It is a further aspect of the present invention to provide 
neuron like nodes, which can be formed and implemented 
utilizing nanotechnology; 10 

It is also an aspect of the present invention to provide a 
physical neural network that can be formed from one or 
more neuron-like nodes. 

It is yet a further aspect of the present invention to provide 
a physical neural network, which can be formed from a 15 
plurality of nanoconductors, such as, for example, nanow- 
ires and/or nanotubes. 

It is still an additional aspect of the present invention to 
provide a physical neural network, which can be imple- 
mented physically in the form of a chip structure. 20 

The above and other aspects can be achieved as is now 
described. A physical neural network based on nanotechnol- 
ogy is disclosed herein, including methods thereof. Such a 
physical neural network generally includes one or more 
neuron-like nodes, connected to a plurality of interconnected 2 5 
nanoconnections. Each neuron-like node sums one or more 
input signals and generates one or more output signals based 
on a threshold associated with the input signal. The physical 
neural network also includes a connection network formed 
from the interconnected nanoconnections, such that the 30 
interconnected nanoconnections used thereof by one or more 
of the neuron-like nodes can be strengthened or weakened 
according to an application of an electric field. Alignment 
has also been observed with a magnetic field, but electric 
fields are generally more practical. Note that the connection 35 
network is associated with one or more of the neuron-like 
nodes. 

The output signal is generally based on a threshold below 
which the output signal is not generated and above which the 
output signal is generated. The transition from zero output to 40 
high output need not necessarily be abrupt or non linear. The 
connection network comprises a number of layers of 
nanoconnections, wherein the number of layers is equal to a 
number of desired outputs from the connection network. The 
nanoconnections are formed without influence from distur- 45 
bances resulting from other nanoconnections thereof. Such 
nanoconnections may be formed from an electrically con- 
ducting material. The electrically conducting material is 
chosen such that a dipole is induced in the electrically 
conducting material in the presence of an electric field. Such 50 
a nanoconnection may comprise a nanoconductor. 

The connection network itself may comprise a connection 
network structure having a connection gap formed therein, 
and a solution located within the connection gap, such that 
the solution comprises a solvent or suspension and one or 55 
more nanoconductors. Preferably, a plurality of nanocon- 
ductors is present in the solution (i.e., mixture). Note that 
such a solution may comprise a liquid and/or gas. An electric 
field can then be applied across the connection gap to permit 
the alignment of one or more of the nanoconductors within 60 
the connection gap. The nanoconductors can be suspended 
in the solvent, or can lie at the bottom of the connection gap 
on the surface of the chip. Studies have shown that nano- 
tubes can align both in the suspension and/or on the surface 
of the gap. The electrical conductance of the mixture is less 65 
than the electrical conductance of the nanoconductors within 
the solution. 
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The nanoconductors within the connection gap thus expe- 
rience an increased alignment in accordance with an 
increase in the electric field applied across the connection 
gap. Thus, nanoconnections of the neuron-like node that are 
utilized most frequently by the neuron-like node become 
stronger with each use thereof. The nanoconnections that are 
utilized least frequently become increasingly weak and 
eventually dissolve back into the solution. The nanoconnec- 
tions may or may not comprise a resistance, which can be 
raised or lowered by a selective activation of a nanocon- 
nection. They can be configured as nanoconductors such as, 
for example, a nanotube or nanowire. An example of a 
nanotube, which may be implemented in accordance with 
the invention described herein, is a carbon nanotube. 
Additionally, such nanoconnections may be configured as a 
negative connection associated with the neuron-like node. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying figures, in which like reference 
numerals refer to identical or functionally-similar elements 
throughout the separate views and which are incorporated in 
and form part of the specification, further illustrate the 
present invention and, together with the detailed description 
of the invention, serve to explain the principles of the 
present invention. 

FIG. 1 illustrates a graph illustrating a typical activation 
function that can be implemented in accordance with the 
physical neural network of the present invention; 

FIG. 2 depicts a schematic diagram illustrating a diode 
configuration as a neuron, in accordance with a preferred 
embodiment of the present invention; 

FIG. 3 illustrates a block diagram illustrating a network of 
nanoconnections formed between two electrodes, in accor- 
dance with a preferred embodiment of the present invention; 

FIG. 4 depicts a block diagram illustrating a plurality of 
connections between inputs and outputs of a physical neural 
network, in accordance with a preferred embodiment of the 
present invention; 

FIG. 5 illustrates a schematic diagram of a physical neural 
network that can be created without disturbances, in accor- 
dance with a preferred embodiment of the present invention; 

FIG. 6 depicts a schematic diagram illustrating an 
example of a physical neural network that can be imple- 
mented in accordance with an alternative embodiment of the 
present invention; 

FIG. 7 illustrates a schematic diagram illustrating an 
example of a physical neural network that can be imple- 
mented in accordance with an alternative embodiment of the 
present invention; 

FIG. 8 depicts a schematic diagram of a chip layout for a 
connection network that may be implemented in accordance 
with an alternative embodiment of the present invention; 

FIG. 9 illustrates a flow chart of operations illustrating 
operational steps that may be followed to construct a con- 
nection network, in accordance with a preferred embodi- 
ment of the present invention; 

FIG. 10 depicts a flow chart of operations illustrating 
operational steps that may be utilized to strengthen nano- 
conductors within a connection gap, in accordance with a 
preferred embodiment of the present invention; 

FIG. 11 illustrates a schematic diagram of a circuit 
illustrating temporal summation within a neuron, in accor- 
dance with a preferred embodiment of the present invention; 
and 

FIG. 12 depicts a block diagram illustrating a pattern 
recognition system, which may be implemented with a 
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physical neural network device, in accordance with an -10 to +10 and a range of output values from approximately 

alternative embodiment of the present invention. 0 to 1. As more neural networks (i.e., active inputs) are 

established, the overall output as indicated at line 105 climbs 

DETAILED DESCRIPTION OF THE until the saturation level indicated by line 106 is attained. If 

INVENTION 5 a connection is not utilized, then the level of output (i.e., 

The particular values and configurations discussed in connection strength) begins to fade until it is revived. This 

these non-limiting examples can be varied and are cited phenomenon is analogous to short term memory loss of a 

merely to illustrate an embodiment of the present invention human brain - Note that § ra P n 100 is presented for generally 

and are not intended to limit the scope of the invention. illustrative and edification purposes only and is not consid- 

The physical neural network described and disclosed 10 ered a limiting feature of the present invention, 

herein is different from prior art forms of neural networks in In a Knowm, the neuron-like node can be configured as a 

that the disclosed physical neural network does not require standard diode-based circuit, the diode being the most basic 

a computer simulation for training, nor is its architecture semiconductor electrical component, and the signal it sums 

based on any current neural network hardware device. The may be a voltage. An example of such an arrangement of 

design of the physical neural network of the present inven- 15 circuitry is illustrated in FIG. 2, which generally depicts a 

tion is actually quite "organic". The physical neural network schematic diagram illustrating a diode-based configuration 

described herein is generally fast and adaptable, no matter as a neuron 200 > in accordance with a preferred embodiment 

how large such a physical neural network becomes. The of the present invention. Those skilled in the art can appre- 

physical neural network described herein can be referred to ciate that the use of such a diode-based configuration is not 

generically as a Knowm. The terms "physical neural net- 20 considered a limiting feature of the present invention, but 

work" and "Knowm" can be utilized interchangeably to merely represents one potential arrangement in which the 

refer to the same device, network, or structure. present invention may be implemented. 

Network orders of magnitude larger than current VSLI Although a diode may not necessarily be utilized, its 

neural networks can be built and trained with a standard current versus voltage characteristics are non-linear when 

computer. One consideration for a Knowm is that it must be used with associated resistors and similar to the relationship 

large enough for its inherent parallelism to shine through. depicted in FIG. 1. The use of a diode as a neuron is thus not 

Because the connection strengths of such a physical neural a limiting feature of the present invention, but is only 

network are dependant on the physical movement of nano- referenced herein with respect to a preferred embodiment, 

connections thereof, the rate at which a small network can The use of a diode and associated resistors with respect to a 

learn is generally very small and a comparable network preferred embodiment simply represents one potential "neu- 

simulation on a standard computer can be very fast. On the ron" implementation. Such a configuration can be said to 

other hand, as the size of the network increases, the time to comprise an artificial neuron. It is anticipated that other 

train the device does not change. Thus, even if the network devices and components may be utilized instead of a diode 

takes a full second to change a connection value a small to construct a physical neural network and a neuron-like 

amount, if it does the same to a billion connections node (i.e., artificial neuron), as indicated here, 

simultaneously, then its parallel nature begins to express Thus, neuron 200 comprises a neuron-like node that may 

itself. include a diode 206, which is labeled D 1? and a resistor 204, 

Aphysical neural network (i.e., a Knowm) must have two which is labeled R 2 . Resistor 204 is connected to a ground 

components to function properly. First, the physical neural 40 210 and an input 205 of diode 206. Additionally, a resistor 

network must have one or more neuron-like nodes that sum 202, which is represented as a block and labeled R a can be 

a signal and output a signal based on the amount of input connected to input 205 of diode 206. Block 202 includes an 

signal received. Such a neuron-like node is generally non- input 212, which comprises an input to neuron 200. A 

linear in its output. In other words, there should be a certain resistor 208, which is labeled R 3 , is also connected to an 

threshold for input signals, below which nothing is output 45 output 214 of diode 206. Additionally, resistor 208 is 

and above which a constant or nearly constant output is coupled to ground 210. Diode 206 in a physical neural 

generated or allowed to pass. This is a very basic require- network is analogous to a neuron of a human brain, while an 

ment of standard software -based neural networks, and can associated connection formed thereof, as explained in 

be accomplished by an activation function. The second greater detail herein, is analogous to a synapse of a human 

requirement of a physical neural network is the inclusion of 50 brain. 

a connection network composed of a plurality of intercon- As depicted in FIG. 2, the output 214 is determined by the 

nected connections (i.e., nanoconnections). Such a connec- connection strength of R 2 (i.e., resistor 202). If the strength 

tion network is described in greater detail herein. of R/s connection increases (i.e., the resistance decreases), 

FIG. 1 illustrates a graph 100 illustrating a typical acti- then the output voltage at output 214 also increases. Because 

vation function that can be implemented in accordance with 55 diode 206 conducts essentially no current until its threshold 

the physical neural network of the present invention. Note voltage (e.g., approximately 0.6V for silicon) is attained, the 

that the activation function need not be non-linear, although output voltage will remain at zero until R a conducts enough 

non-linearity is generally desired for learning complicated current to raise the pre -diode voltage to approximately 0.6V. 

input-output relationships. The activation function depicted After 0.6V has been achieved, the output voltage at output 

in FIG. 1 comprises a linear function, and is shown as such 60 214 will increase linearly. Simply adding extra diodes in 

for general edification and illustrative purposes only. As series or utilizing different diode types may increase the 

explained previously, an activation function may also be threshold voltage. 

non-linear. An amplifier may also be added to the output 214 of diode 

As illustrated in FIG. 1, graph 100 includes a horizontal 206 so that the output voltage immediately saturates at the 

axis 104 representing a sum of inputs, and a vertical axis 102 65 diode threshold voltage, thus resembling a step function, 

representing output values. A graphical line 106 indicates until a threshold value and a constant value above the 

threshold values along a range of inputs from approximately threshold is attained. R 3 (i.e., resistor 208) functions gener- 
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ally as a bias for diode 206 (i.e., D 2 ) and should generally outputs. Nanotubes, nanowires, nanoparticles and/or other 

be about 10 times larger than resistor 204 (i.e., R 2 ). In the nanoconducting structures may be utilized, of course, to 

circuit configuration illustrated in FIG. 2, R 2 can actually be construct nanoconnections 304 between input 302 and input 

configured as a network of connections composed of many 306. Although a single input 302 and a single input 306 is 

inter-connected conducting nanowires (i.e., see FIG. 3). As 5 depicted in FIG. 3, it can be appreciated that a plurality of 

explained previously, such connections are analogous to the inputs and a plurality of outputs may be implemented in 

synapses of a human brain. accordance with the present invention, rather than simply a 

FIG. 3 illustrates a block diagram illustrating a network single input 302 or a single output 306. 

300 of nanoconnections 304 formed between two electrodes, FIG. 4 depicts a block diagram illustrating a plurality of 

in accordance with a preferred embodiment of the present 10 nanoconnections 414 between inputs 404, 406, 408, 410, 

invention. Nanoconnections 304 (e.g., nanoconductors) 412 and outputs 416 and 418 of a physical neural network, 

depicted in FIG. 3 are generally located between input 302 in accordance with a preferred embodiment of the present 

and output 306. The network of nanoconnections depicted in invention. Inputs 404, 406, 408, 410, and 412 can provide 

FIG. 3 can be implemented as a network of nanoconductors. in P ut si § nals to connections 414. Output signals can then be 

Examples of nanoconductors include devices such as, for generated from connections 414 via outputs 416 and 418. A 

example, nanowires, nanotubes, and nanoparticles. Nano- connection network can therefore be configured from the 

connections 304, which are analogous to the synapses of a P lurah £ of connections 414. Such a connection network is 

u u • 1 1 j i_ j i? 1 * • 1 j *• generally associated with one or more neuron-luce nodes, 

human brain, should be composed of electrical conducting & J . , i . , 

material (i.e., nanoconductors). It should be appreciated by . The c ° nne f on netw ° rk als ° comprises a plurality of 

tU 1 . , 1 • t , + .1 4 1 A \ , interconnected nanoconnections, wherein each nanoconnec- 

those skilled in the art that such nanoconductors can be on A . 4l r . it _ - ' - , ... 

. , , . . A r 1 1 • • 1 a. a zu tion thereof is strengthened or weakened according to an 

provided in a variety 01 shapes and sizes without departing c 1 * • .c u a * 1 • 

K . , . : . r r & application 01 an electric field. A connection network is not 

irom the teachings herein. possible if built in one layer because the presence of one 

For example, carbon particles (e.g., granules or bearings) connection can alter the electric field so that other connec- 

may be used for developing nanoconnections. The nanocon- tions between adjacent electrodes could not be formed, 

ductors utilized to form a connection network may be 25 Instead, such a connection network can be built in layers, so 

formed as a plurality of nanoparticles. For example, each that each connection thereof can be formed without being 

nanoconnection within a connection network may be formed influenced by field disturbances resulting from other con- 

from a chain of carbon nanoparticles. In "Self-assembled nections. This can be seen in FIG. 5. 

chains of graphitized carbon nanoparticles" by Bezryadin et FIG. 5 illustrates a schematic diagram of a physical neural 

al., Applied Physics Letters, Vol. 74, No. 18, pp. 2699-2701, 30 network 500 that can be created without disturbances, in 

May 3, 1999, for example, a technique is reported, which accordance with a preferred embodiment of the present 

permits the self-assembly of conducting nanoparticles into invention. Physical neural network 500 is composed of a 

long continuous chains. Bezryadin et al. suggest that new first layer 558 and a second layer 560. A plurality of inputs 

approaches could be developed in order to organize nano- 502, 504, 506, 508, and 510 are respectively provided to 

particles into useful electronic devices. Thus, nanoconduc- 35 layers 558 and 560 respectively via a plurality of input lines 

tors utilized to form a physical neural network (i.e., Knowm) 512, 514, 516, 518, and 520 and a plurality of input lines 

could be formed from nanoparticles. 522, 524, 526, 528, and 530. Input lines 512, 514, 516, 518, 

It should be appreciated by those skilled in the art that the and 520 are further coupled to input lines 532, 534, 536, 538, 

Bezyadin et al reference does not, of course, comprise and 540 such that each line 532, 534, 536, 538, and 540 is 

limiting features of the present invention, nor does it teach, 40 respectively coupled to nanoconnections 572, 574, 576, 578, 

suggest nor anticipate a physical neural network. Rather, and 580. Thus, input line 532 is connected to nanconnections 

such a reference merely demonstrate recent advances in the 572. Input line 534 is connected to nanoconnections 574, 

carbon nanotechnology arts and how such advances may be and input line 536 is connected to nanoconnections 576. 

adapted for use in association with the Knowm -based sys- Similarly, input line 538 is connected to nanconnections 

tern described herein. It can be further appreciated that a 45 578, and input line 540 is connected to nanoconnections 

connection network as disclosed herein may be composed 580. 

from a variety of different types of nanoconductors. For Nanconnections 572, 574, 576, 578, and 580 may corn- 
example, a connection network may be formed from a prise nanoconductors such as, for example, nanotubes and/or 
plurality of nanoconductors, including nanowires, nanotubes nanowires. Nanoconnections 572, 574, 576, 578, and 580 
and/or nanoparticles. Note that such nanowires, nanotubes 50 thus comprise one or more nanoconductors. Additionally, 
and/or nanoparticles, along with other types of nanoconduc- input lines 522, 524, 526, 528, and 530 are respectively 
tors can be formed from materials such as carbon or silicon. coupled to a plurality of input lines 542, 544, 546, 548 and 
For example, carbon nanotubes may comprise a type of 550, which are in turn each respectively coupled to nano- 
nanotube that can be utilized in accordance with the present connections 582, 584, 586, 588, and 590. Thus, for example, 
invention. 55 input line 542 is connected to nanoconnections 582, while 
As illustrated in FIG. 3, nanoconnections 304 comprise a input line 544 is connected to nanoconnections 584. 
plurality of interconnected nanoconnections, which from Similarly, input line 546 is connected to nanoconnections 
this point forward, can be referred to generally as a "con- 586 and input line 548 is connected to nanoconnections 588. 
nection network." An individual nanoconnection may con- Additionally, input line 550 is connected to nanconnections 
stitute a nanoconductor such as, for example, a nanowire, a 60 590. Box 556 and 554 generally represent simply the output 
nanotube, nanoparticles(s), or any other nanoconducting and are thus illustrated connected to outputs 562 and 568. In 
structures. Nanoconnections 304 may comprise a plurality other words, outputs 556 and 554 respectively comprise 
of interconnected nanotubes and/or a plurality of intercon- outputs 562 and 568. The aforementioned input lines and 
nected nanowires. Similarly, nanoconnections 304 may be associated components thereof actually comprise physical 
formed from a plurality of interconnected nanoparticles. A 65 electronic components, including conducting input and out- 
connection network is thus not one connection between two put lines and physical nanoconnections, such as nanotubes 
electrodes, but a plurality of connections between inputs and and/or nanowires. 
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Thus, the number of layers 558 and 560 equals the of many things. The only requirements are that the conduct- 
number of desired outputs 562 and 568 from physical neural ing wires must be suspended in the solvent, either dissolved 
network 500. In the previous two figures, every input was or in some sort of suspension, free to move around; the 
potentially connected to every output, but many other con- electrical conductance of the substance must be less than the 
figurations are possible. The connection network can be 5 electrical conductance of the suspended conducting wire; 
made of any electrically conducting material, although the and the viscosity of the substance should not be too much so 
physics of it requires that they be very small so that they will mat the conducting wire cannot move when an electric field 
align with a practical voltage. Carbon nano tubes or any * s a PP^ e d- 

conductive nanowire can be implemented in accordance The § oal for such a connection network is to develop a 

with the physical neural network described herein. 10 network of connections of just the right values so as to 

0 , c . . , satisfy the particular signal -processing requirement — 
Such components can lorm connections between elec- . . / i 7 i j 0 t 

j ■« .-i r i . . £ u Ti i exactly what a neural network does. Such a connection 

trodes by the presence of an electric field. For example, the . \ u . , « . . u 

. , , • j i . r , A , i, network can be constructed by applying a voltage across a 

orientation and purification of carbon nano tubes has been . - u +u . / rr J .. e , . ^ 

, * . « , ... lilt space occupied by the mixture mentioned, lo create the 

demonstrated using ac electrophoresis in isopropyl alcohol, r *• * i *u • * * • 1 1 1 

. A . . * . A A . r , 'a 5 * i k connection network, the input terminals are selectively 

as indicated in Orientation and purification or carbon ^ . , ± 1-1*1 • 1 

A t . , , . „ 1 . 1 t raised to a positive voltage while the output terminals are 

nanotubes using ac electrophoresis by Yamamoto et al., J. 1 *• 1 1 1 ^1 1 n r 

n , ~ A i- r» u • ^/mno\ t ia ^ ajjv ii selectively grounded. Thus, connections can gradually form 

Phys. D: Applied Physics, 31(1998), L34-36. Additionally, * 4 , ' m. . . 4 . 

•; j Vi * u • 1 4. v . between the inputs and outputs. The important requirement 

an electric-field assisted assembly technique used to position ^ A t Al r , . , r , t , r *i 

. j. • i • j j • i * • j- mat makes the physical neural network of the present 

individual nanowires suspended in an electric medium . - i . r j t , . Al A ^ \ 

u . i * j j « j i-*u u- ii o-^o on invention functional as a neural network is that the longer 

between two electrodes defined lithographically on an SiOz zu Al . , A . „ , . . , ?< 

1 . , • • j • < • • .c i • i j 11 1 this electric field is applied across a connection gap, or the 
substrate is indicated in Electric-field assisted assembly and +u - rr r . , .« + u 

r , „. . „i o -*i * i a 1- i greater the Irequency or amplitude, the more nanotubes 

alignment of metallic nanowires, by Smith et al., Applied to . /. ' - , +u 

„, . t j T r 1 „„ XT „ a ™ ™^ y j , and/or nanowires and/or particles align and the stronger the 

Physics Letters, Vol. 77, Num. 9, Aug. 28, 200. It can be ' . +u *u *u * 

^ . . j, 1 -ii j • *i_ 1 / i r connection thereol becomes. 1 hus, the connections that are 

appreciated by those skilled in the art that such references - . c « .« ' . t , . t 

•j j,. v r . r.i_ oc utilized most Irequently by the physical neural network 

are not considered limiting leatures ol the present invention, 25 t x1 -i ^ ^ x- ^ 

, u r * u * f • • . u • i become the strongest, 

nor do such relerences teach, suggest or anticipate a physical , . & . . . „ r 

neural network as described herein. Such references are ^ connections can either be initially formed and have 

discussed herein for general background and illustrative random "^stances or no connections may be formed at all. 

purposes only ^ initially forming random connections, it might be pos- 

, 1 . . - - in sible to teach the desired relationships faster, because the 

Additionally, it has been reported that it is possible to base connections do not have to be 5uilt from scratch> 

fabricate deterministic wiring networks from single-walled D di on the rate of connection deC ay, having initial 

carbon nanotubes (SWNTs as indicated in Self- mndom connections could ove faster? alth h not nec . 

Assembled Deterministic Carbon ^Nanotube Wiring Net- essadl The connection network can ad t itself to the 

works by Diehi, et al. in Angew. Chem Int. Ed. 2002 41. re irements of a iven situation regard i e ss of the initial 

No. 2. In addition, the publication Indium phosphide state of the connec tions. Either initial condition will work, as 

nanowires as building blocks for nanoscale electronic and connections that are not used will " disso lve" back into 

optoelectronic devices by Duan, et ^a Nature Vol. 409, so i ution . T he resistance of the connection can be maintained 

Jan . 4, 2001, reports that an electnc-field-directed assembly Qf bwered b sdective activations of the connection . i n 

can be used to create highly integrated device arrays from Qther WQrds? if ^ connection is not used? it win fade 

nanowire building blocks It should be appreciated by those analogous to the connections between neurons in a human 

skilled in the art these references do not comprise limiting bmin The te ature of tne solution can also be main . 

features of the present invention, nor do such references tained ^ a rticular value so that the rate that connections 

teach or anticipate a physical neural network. Rather, such fade can be controllecL Additionally an electric field 

references are incorporated herein by reference to demon- can be ^ dicular to the connections t0 weaken 

strate recent advances in the carbon nanotechnology arts and them? Qr eyen erase them Qut alt ther (Lc as in clear? 

how such advances may be adapted for use in association ^ Qf reformatti of a u&^y 

with the physical neural network described herein. _ u .. + . , . 

r J 1 he nanoconnections may or may not be arranged in an 

The only general requirements for the conducting material orderly array pattern . Th e nanoconnections (e.g., nanotubes, 

utilized to configure the nanoconductors are that such con- 5Q nanowires? etc ) of a physical neural network do not have to 

ducting material must conduct electricity, and a dipole order themselves into neatly formed arrays. They simply 

should preferably be induced in the material when in the float in the solution5 or lie at the bottom of the gap? and more 

presence of an electric field. Alternatively, the nanoconduc- or less Hne up in me presence an electric field< Precise 

tors utilized in association with the physical neural network pat terns are thus not necessary. In fact, neat and precise 

described herein can be configured to include a permanent 55 patterns may not be desired Rather? due to the non .i inear 

dipole that is produced by a chemical means, rather than a nature of neural networ ks, precise patterns could be a 

dipole that is induced by an electric field. drawback rather than an advantage. In fact, it may be 

Therefore, it should be appreciated by those skilled in the desirable that the connections themselves function as poor 

art that a connection network could also be comprised of conductors, so that variable connections are formed thereof, 

other conductive particles that may be developed or found 60 overcoming simply an "on" and "off" structure, which is 

useful in the nanotechnology arts. For example, carbon commonly associated with binary and serial networks and 

particles (or "dust") may also be used as nanoconductors in structures thereof. 

place of nanowires or nanotubes. Such particles may include fig. 6 depicts a schematic diagram illustrating an 

bearings or granule-like particles. example of a physical neural network 600 that can be 

A connection network can be constructed as follows: A 65 implemented in accordance an alternative embodiment of 

voltage is applied across a gap that is filled with a mixture the present invention. Note that in FIGS. 5 and 6, like parts 

of nanowires and a "solvent". This mixture could be made are indicated by like reference numerals. Thus, physical 
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neural network 600 can be configured, based on physical nections being weakened in a physical system is the essence 
neural network 500 illustrated in FIG. 5. In FIG. 6, inputs 1, of a physical neural network (i.e., Knowm). Thus, it can be 
2, 3, 4, and 5 are indicated, which are respectively analogous appreciated that the training of such a physical neural 
to inputs 502, 504, 506, 508, and 510 illustrated in FIG. 5. network may not require a "CPU" to calculate connection 
Outputs 562 and 568 are provided to a plurality of electrical 5 values thereof. The Knowm can adapt itself. Complicated 
components to create a first output 626 (i.e., Output 1) and neural network solutions could be implemented very rapidly 
a second output 628 (i.e., Output 2). Output 562 is tied to a "on the fly", much like a human brain adapts as it performs, 
resistor 606, which is labeled R2 and a diode 616 at node A. T h e physical neural network disclosed herein thus has a 
Output 568 is tied to a resistor 610, which is also labeled R2 number of broad applications. The core concept of a 
and a diode 614 at node C. Resistors 606 and 610 are each 10 Knowm, however, is basic. The very basic idea that the 
tied to a ground 602. connection values between electrode junctions by nanocon- 
Diode 616 is further coupled to a resistor 608, which is ductors can be used in a neural network devise is all that 
labeled R3, and first output 626. Additionally, resistor 608 is required to develop an enormous number of possible con- 
coupled to ground 602 and an input to an amplifier 618. An figurations and applications thereof. 

output from amplifier 618, as indicated at node B and dashed 15 Another important feature of a physical neural network is 

lines thereof, can be tied back to node A. A desired output the ability to form negative connections. This is an important 

622 from amplifier 618 is coupled to amplifier 618 at node f eature that makes possible inhibitory effects useful in data 

H. Diode 614 is coupled to a resistor 612 at node F. Note that processing. The basic idea is that the presence of one input 

resistor 612 is labeled R3. Node F is in turn coupled to an can inhibit the effect of another input. In artificial neural 

input of amplifier 620 and to second output 628 (i.e., Output 20 networks as they curren tly exist, this is accomplished by 

2). Diode 614 is also connected to second output 628 and an multiplying the input by a negative connection value, 

input to amplifier 620 at second output 628. Note that second Unfortunately, with a Knowm-based device, the connection 

output 628 is connected to the input to amplifier 620 at node may 0 nly ta ke on zero or positive values under such a 

F. An output from amplifier 620 is further coupled to node scenario. 

D, which in turn is connected to node C. A desired output 25 In ^ ^ ^ be & CQnnection Qr nQ 

624, which is indicated by a dashed line in FIG. 6, is also connec tion. A connection can simulate a negative connec- 

coupled to an input of amplifier 620 at node E. tk)n by dedicating a particu i ar connection to be negative, but 

In FIG. 6, the training of physical neural network 600 can 0 ne connection cannot begin positive and through a learning 

be accomplished utilizing, for example, op-amp devices process change to a negative connection. In general, if it 

(e.g., amplifiers 618 and 620). By comparing an output (e.g., starts positive, it can only go to zero. In essence, it is the idea 

first output 626) of physical neural network 600 with a 0 f possessing a negative connection initially that results in 

desired output (e.g., desired output 622), the amplifier (e.g., the simulation, because this does not occur in a human brain, 

amplifier 618) can provide feedback and selectively Only one type of signal generally travels through axon/ 

strengthen connections thereof. For instance, suppose it is dendrites in a human brain. That signal is transferred into the 

desired to output a voltage of +V at first output 626 (i.e., flow of a neurotransmitter whose effect on the postsynaptic 

Output 1) when inputs 1 and 4 are high. When inputs 1 and neuron can be either excitatory or inhibitory, depending on 

4 are taken high, also assume that first output 626 is zero. the neuron. 

Amplifier 618 can then compare the desired output (+V) 0ne method for soMng this prob i em is to utilize two sets 

with the actual output (0) and output -V. In this case, -V is ^ 0 f connections for the same output, having one set represent 

equivalent to ground. me positive connections and the other set represent the 

The op-amp outputs and grounds the pre-diode junction negative connections. The output of these two layers can be 

(i.e., see node A) and causes a greater electric field across compared, and the layer with the greater output will output 

inputs 1 and 4 and the layer 1 output. This increased electric either a high signal or a low signal, depending on the type 

field (larger voltage drop) can cause the nanoconductors in 45 of connection set (inhibitory or excitatory). This can be seen 

the solution between the electrode junctions to align in FIG. 7. 

themselves, aggregate, and form a stronger connection FIG. 7 illustrates a schematic diagram illustrating an 

between the land 4 electrodes. Feedback can continue to be example of a physical neural network 700 that can be 

applied until output of physical neural network 600 matches implemented in accordance with an alternative embodiment 

the desired output. The same procedure can be applied to 5Q of the present invention. Physical neural network 700 thus 

every output. comprises a plurality of inputs 702 (not necessarily binary) 

In accordance with the aforementioned example, assume which are respectively fed to layers 704, 706, 708, and 710. 

that Output 1 was higher than the desired output (i.e., desired Each layer is analogous to the layers depicted earlier, such 

output 622). If this were the case, the op- amp output can be as for example layers 558 and 560 of FIG. 5. An output 713 

+V and the connection between inputs 1 and 4 and layer one 55 of layer 704 can be connected to a resistor 712, a transistor 

output can be raised to +V. Columbic repulsions between the 720 and a first input 727 of amplifier 726. Transistor 720 is 

nanoconductors can force the connection apart, thereby generally coupled between ground 701 and first input 727 of 

weakening the connection. The feedback will then continue amplifier 726. Resistor 712 is connected to a ground 701. 

until the desired output is obtained. This is just one training Note that ground 701 is analogous to ground 602 illustrated 

mechanism. One can see that the training mechanism does 60 in FIG. 6 and ground 210 depicted in FIG. 2. A second input 

not require any computations, because it is a simple feed- 729 of amplifier 726 can be connected to a threshold voltage 

back mechanism. 756. The output of amplifier 726 can in turn be fed to an 

Such a training mechanism, however, may be imple- inverting amplifier 736. 

mented in many different forms. Basically, the connections The output of inverting amplifier 736 can then be input to 

in a connection network must be able to change in accor- 65 a NOR device 740. Similarly, an output 716 of layer 706 

dance with the feedback provided. In other words, the very may be connected to resistor 714, transistor 733 and a first 

general notion of connections being strengthened or con- input 733 of an amplifier 728. A threshold voltage 760 is 
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connected to a second input 737 of amplifier 728. Resistor network, but instead teaches the formation of a discrete 

714 is generally coupled between ground 701 and first input carbon nanotube transistor. Thus, U.S. Patent Application 

733 of amplifier 728. Note that first input 733 of amplifier No. 200 1/0023 98 6 Al is not considered a limiting feature of 
728 is also generally connected to an output 715 of layer the present invention, nor does this reference teach, antici- 
706. The output of amplifier 728 can in turn be provided to 5 pate or suggest the invention described herein. Instead, this 
NOR device 740. The output from NOR device 740 is reference is discussed briefly herein for background pur- 
generally connected to a first input 745 of an amplifier 744. poses only and to generally illustrate the use of a particular 
An actual output 750 can be taken from first input 745 to type of discrete transistor in the nanodomain. 

amplifier 744. A desired output 748 can be taken from a A truth table for the output of circuit 700 is illustrated at 
second input 747 to amplifier 744. The output from amplifier 10 block 780 in FIG. 7. As indicated at block 780, when an 
744 is generally provided at node A, which in turn is excitatory output is high and the inhibitory output is also 
connected to the input to transistor 720 and the input to high, the final output is low. When the excitatory output is 
transistor 724. Note that transistor 724 is generally coupled high and the inhibitory output is low, the final output is high, 
between ground 701 and first input 733 of amplifier 728. The Similarly, when the excitatory output is low and the inhibi- 
second input 731 of amplifier 728 can produce a threshold 15 tory output is high, the final output is low. When the 
voltage 760. excitatory output is low and the inhibitory output is also low, 
Layer 708 provides an output 717 that can be connected the final output is low. Note that layers 704 and 708 may thus 
to resistor 716, transistor 725 and a first input 737 to an comprise excitatory connections, while layers 706 and 710 
amplifier 732. Resistor 716 is generally coupled between may comprise inhibitory connections, 
ground 701 and the output 717 of layer 708. The first input 2 o F° r every desired output, two sets of connections are 
737 of amplifier 732 is also electrically connected to the used. The output of a two-diode neuron can be fed into an 
output 717 of layer 708. A second input 735 to amplifier 732 op-amp (e.g., a comparator). If the output that the op-amp 
may be tied to a threshold voltage 758. The output from receives is low when it should be high, the op -amp outputs 
amplifier 732 can in turn be fed to an inverting amplifier 738. a low signal. This low signal can cause the transistors (e.g., 
The output from inverting amplifier 738 may in turn be 2 s transistors 720, 725) to saturate and ground out the pre-diode 
provided to a NOR device 742. Similarly, an output 718 junction for the excitatory diode. This causes, like before, an 
from layer 710 can be connected to a resistor 719, a increase in the voltage drop across those connections that 
transistor 728 and a first input 739 of an amplifier 734. Note need to increase their strength. Note that only those con- 
that resistor 719 is generally coupled between node 701 and nections going to the excitatory diode are strengthened, 
the output 719 of layer 710. A second input 741 of amplifier 30 Likewise, if the desired output were low when the actual 

734 may be coupled to a threshold voltage 762. The output output was high, the op -amp can output a high signal. This 
from of NOR device 742 is generally connected to a first can cause the inhibitory transistor (e.g., an NPN transistor) 
input 749 of an amplifier 746. A desired output 752 can be to saturate and ground out the neuron junction of the 
taken from a second input 751 of amplifier 746. An actual inhibitory connections. Connections going to the inhibitory 
output 754 can be taken from first input 749 of amplifier 746. 35 diode can thereafter strengthen. 

The output of amplifier 746 may be provided at node B, At all times during the learning process, a weak alternat- 
which in turn can be tied back to the respective inputs to ing electric field can be applied perpendicular to the con- 
transistors 725 and 728. Note that transistor 725 is generally nections. This can cause the connections to weaken by 
coupled between ground 701 and the first input 737 of rotating the nanotube perpendicular to the connection direc- 
amplifier 732. Similarly, transistor 728 is generally con- 40 tion. This perpendicular field is important because it can 
nected between ground 701 and the first input 739 of allow for a much higher degree of adaptation. To understand 
amplifier 734. this, one must realize that the connections cannot 

Note that transistors 720, 724, 725 and/or 728 each can (practically) keep getting stronger and stronger. By weak- 
essentially function as a switch to ground. A transistor such ening those connections not contributing much to the desired 
as, for example, transistor 720, 724, 725 and/or 728 may 45 output, we decrease the necessary strength of the needed 
comprise a field-effect transistor (FET) or another type of connections and allow for more flexibility in continuous 
transistor, such as, for example, a single -electron transistor training. This perpendicular alternating voltage can be real- 
(SET). Single-electron transistor (SET) circuits are essential ized by the addition of two electrodes on the outer extremity 
for hybrid circuits combining quantum SET devices with of the connection set, such as plates sandwiching the con- 
conventional electronic devices. Thus, SET devices and 50 nections (i.e., above and below). Other mechanisms, such as 
circuits may be adapted for use with the physical neural increasing the temperature of the nanotube suspension could 
network of the present invention. This is particularly impor- also be used for such a purpose, although this method is 
tant because as circuit design rules begin to move into perhaps a little less controllable or practical, 
regions of the sub-100 nanometer scale, where circuit paths The circuit depicted in FIG. 7 can be separated into two 
are only 0.001 of the thickness of a human hair, prior art 55 separate circuits. The first part of the circuit can be corn- 
device technologies will begin to fail, and current leakage in posed of nanotube connections, while the second part of the 
traditional transistors will become a problem. SET offers a circuit comprises the "neurons" and the learning mechanism 
solution at the quantum level, through the precise control of (i.e., op-amps/comparator). The learning mechanism on first 
a small number of individual electrons. glance appears similar to a relatively standard circuit that 

Transistors such as transistors 720, 724, 725 and/or 72 8 60 could be implemented on silicon with current technology, 

can also be implemented as carbon nanotube transistors. An Such a silicon implementation can thus comprise the "neu- 

example of a carbon nanotube transistor is disclosed in U.S. ron" chip. The second part of the circuit (i.e., the 

Patent Application No. 2001/0023986A1 to Macevski, connections) is thus a new type of chip, although it could be 

which is dated Sep. 27, 2001 and is entitled, "System and constructed with current technology. The connection chip 

Method for Fabricating Logic Devices Comprising Carbon 65 can be composed of an orderly array of electrodes spaced 

Nanotube Transistors." U.S. Patent Application No. 2001/ anywhere from, for example, 100 nm to 1 /urn or perhaps 

0023986A1 does not teach or claim a physical neural even further. In a biological system, one talks of synapses 
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connecting neurons. It is in the synapses where the infor- neural network (i.e., a Knowm) can permit all training 

mation is processed, (i.e., the "connection weights"). sessions to occur simultaneously, no matter now large the 

Similarly, such a chip can contain all of the synapses for the associated connection network. Second, recent research has 

physical neural network. A possible arrangement thereof can indicated that near perfect aligning of nanotubes can be 

be seen in FIG. 8. 5 accomplished, for example, in approximately 15 minutes. If 

FIG. 8 thus illustrates a possible chip layout for a con- one considers that the input data, arranged as a vector of 

nection chip (i.e., connection network 800) that can be binary "highs and low's" is presented to the Knowm 

implemented in accordance with the present invention. FIG. simultaneously, and that all training vectors are presented 

8 thus illustrates a possible chip layout for a connection chip one after the other in rapid succession (e.g., 100 MHz or 

(i.e., s connection network 800 that can be implemented in 1Q more), then each connection would "see" a different fre- 

accordance with the present invention. Chip layout 800 can quency in direct proportion to the amount of time that its 

include an input array composed of a plurality of inputs 801, connection is required for accurate data processing (i.e., 

802, 803, 804, and 805, which are generally provided to a provided by a feedback mechanism). Thus, if it only takes 

plurality of layers 806, 807, 808, 809, 810, 811, 812, 813, for example, approximately 15 minutes to attain an almost 

814, and 815. Aplurality of outputs 802 can be derived from 5 perfect state of alignment, then this amount of time would 

layers 806, 807, 808, 809, 810, 811, 812, 813, 814, and 815. comprise the longest amount of time required to train, 

Inputs 801 can be coupled to layers 806 and 807, while assuming that all of the training vectors are presented during 

inputs 802 can be connected to layers 808 and 809. that particular time period. 

Similarly, inputs 803 can be connected to layers 810 and FIG. 9 illustrates a flow chart 900 of operations illustrat- 

811. Also, inputs 804 are generally connected to layers 812 2Q ing operational steps that may be followed to construct a 

and 813. Inputs 805 are generally connected to layers 814 connection network, in accordance with a preferred embodi- 

and 815. ment of the present invention. Initially, as indicated at block 

Similarly, such an input array can includes a plurality of 902, a connection gap is created from a connection network 
inputs 831, 832, 833, 834 and 835 which are respectively structures. As indicated earlier, the goal for such a connec- 
input to a plurality of layers 816, 817, 818, 819, 820, 821, 25 tion network is generally to develop a network of connec- 
822, 823, 824 and 825. Thus, inputs 831 are connected to tions of "just" the right values to satisfy particular informa- 
layers 816 and 817, while inputs 832 are coupled to layers tion processing requirements, which is precisely what a 
818 and 819. Additionally, inputs 833 are connected to neural network accomplishes. As illustrated at block 904, a 
layers 820 and 821. Inputs 834 are connected to layers 822 solution is prepared, which is composed of nanoconductors 
and 823. Finally, inputs 835 are connected to layers 824 and 30 and a "solvent." Note that the term "solvent" as utilized 
825. Arrows 828 and 830 represent a continuation of the herein has a variable meaning, which includes the traditional 
aforementioned connection network pattern. Those skilled meaning of a "solvent," and also a suspension, 
in the art can appreciate, of course, that chip layout 800 is The solvent utilized can comprise a volatile liquid that can 
not intended to represent an exhaustive chip layout or to be confined or sealed and not exposed to air. For example, 
limit the scope of the invention. Many modifications and 35 the solvent and the nanoconductors present within the result- 
variations to chip layout 800 are possible in light of the ing solution may be sandwiched between wafers of silicon 
teachings herein without departing from the scope of the or other materials. If the fluid has a melting point that is 
present invention. It is contemplated that the use of a chip approximately at room temperature, then the viscosity of the 
layout, such as chip layout 800, can involve a variety of fluid could be controlled easily. Thus, if it is desired to lock 
components having different characteristics. 40 the connection values into a particular state, the associated 

Preliminary calculations by the present inventor based on physical neural network (i.e., Knowm) may be cooled 

a maximum etching capability of 200 nm resolution have slightly until the fluid freezes. The term "solvent" as utilized 

indicated that over 4 million synapses could fit on an area of herein thus can include fluids such as for example, toluene, 

approximately 1 cm 2 . The smallest width that an electrode hexadecane, mineral oil, etc. Note that the solution in which 

can possess is generally based on current lithography. Such 45 the nanoconductors (i.e., nanoconnections) are present 

a width may of course change as the lithographic arts should generally comprise a dielectric. Thus, when the 

advance. This value is actually about 70 nm for state-of- resistance between the electrodes is measured, the conduc- 

the-art techniques currently. These calculations are of course tivity of the nanoconductors is essentially measured, not that 

extremely conservative, and are not considered a limiting of the solvent. The nanoconductors can be suspended in the 

feature of the present invention. Such calculations are based 50 solution or can alternately lie on the bottom surface of the 

on an electrode with, separation, and gap of approximately connection gap. The solvent may also be provided in the 

200 nm. For such a calculation, 166 connection networks form of a gas. 

comprising 250 inputs and 100 outputs can fit within a one As illustrated thereafter at block 906, the nanoconductors 

square centimeter area. must be suspended in the solvent, either dissolved or in a 

If such chips are stacked vertically, an untold number of 55 suspension of sorts, but generally free to move around, 

synapses could be attained. This is two to three orders of either in the solution or on the bottom surface of the gap. As 

magnitude greater than some of the most capable neural depicted next at block 908, the electrical conductance of the 

network chips out there today, chips that rely on standard solution must be less than the electrical conductance of the 

methods to calculate synapse weights. Of course, the geom- suspended nanoconductor(s). Similarly, the electrical resis- 

etry of the chip could take on many different forms, and it 60 tance of the solution is greater than the electrical resistance 

is quite possible (i.e., based on a conservative lithography of the nanoconductor. 

and chip layout) that many more synapses could fit within Next, as illustrated at block 910, the viscosity of the 

the same space. The training of a neural network chip of this substance should not be too much so that the nanoconduc- 

size would take a fraction of the time of a comparably sized tors cannot move when an electric field (e.g., voltage) is 

traditional chip using digital technology. 6 5 applied. Finally, as depicted at block 912, the resulting 

The training of such a chip is primarily based on two solution of the "solvent" and the nanoconductors is thus 

assumptions. First, the inherent parallelism of a physical located within the connection gap. 
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Note that although a logical series of steps is illustrated in the temporal pronunciation of various syllables. A sentence 

FIG. 9, it can be appreciated that the particular flow of steps is composed of the temporal separation of varying words. 

can be re-arranged. Thus, for example, the creation of the Thoughts are composed of the temporal separation of vary- 

connection gap, as illustrated at block 902, may occur after i ng sentences. Thus, for an individual to understand a spoken 

the preparation of the solution of the solvent and 5 language at all, a syllable, word, sentence or thought must 

nanoconductor(s), as indicated at block 904. FIG. 9 thus exert some type of i n fl uen ce on another syllable, word, 

represents merely possible series of steps, which may be sen tence or thought. The most natural way that one sentence 

followed to create a connection network. It is anticipated can exert influence on another sentence, in the light of 

that a variety of other steps may be fo lowed as long as the neuml network is b a form of t ral summation . ^ at 

goal ol achieving a connection network in accordance with . u / „ +u , .. . , . +u 

f* . • i • j o- m • i 10 is, a neuron remembers the signals it received in the past. 

the present invention is achieved. Similar reasoning also . 

applies to FIG. 10. The human brain accomplishes this feat in an almost 

FIG. 10 depicts a flow chart 1000 of operations illustrat- trivial manner - When a si § nal reaches a neuron > the neuron 

ing operational steps that may be utilized to strengthen has an influx of ions rush through its membrane. The influx 

nanoconductors within a connection gap, in accordance with °f ions contributes to an overall increase in the electrical 

a preferred embodiment of the present invention. As indi- 15 potential of the neuron. Activation is achieved when the 

cated at block 1002, an electric field can be applied across potential inside the cell reaches a certain threshold. The one 

the connection gap discussed above with respect to FIG. 9. caveat is that it takes time for the cell to pump out the ions, 

The connection gap can be occupied by the solution dis- something that it does at a more or less constant rate. So, if 

cussed above. As indicated thereafter at block 1004, to another signal arrives before the neuron has time to pump 

create the connection network, the input terminals can be 20 out a ll 0 f the ions, the second signal will add with the 

selectively raised to a positive voltage while the output remnants of the first signal and achieve a raised potential 

terminals are selectively grounded. As illustrated thereafter greater than that which could have occurred with only the 

at block 1006, connections thus form between the inputs and second signal ^ first signal i n fl uences the second signal, 

the outputs. The important requirements that make the which results in temporal summation, 

resulting physical neural network functional as a neural 2 5 T , i • • i , • 1 i 1 

network is that the longer this electric field is applied across A }^ eme f n § thlS A in a Penological manner has proved 

the connection gap, or the greater the frequency or difficult in the past. Any simulation would have to include a 

amplitude, the more nanoconductors align and the stronger "memory" for the neuron. In a digital representation, this 

the connection becomes. Thus, the connections that get requires data to be stored for every neuron, and this memory 

utilized the most frequently become the strongest. so would nave to be accessed continually. In a computer 

As indicated at block 1008, the connections can either be simulation one must discritize the incoming data, since 
initially formed and have random resistances or no connec- operations (such as summations and learning) occur serially, 
tions will be formed at all. By forming initial random That r ls ' a com P*f r can only do one thing at a time, 
connections, it might be possible to teach the desired rela- Transformations of a signal from the time domain into the 
tionships faster, because the base connections do not have to 35 T^} domain , rec l uir f that time be broke * U P into l dlscret f 
be built up as much. Depending on the rate of connection lei f hs ' something that is not necessarily possible with 
decay, having initial random connections could prove to be real " time analo § S1 § nals in whl f no P™ nt exist u s Wlthm a 
a faster method, although not necessarily. A connection time-varying signal that is uninfluenced by another point, 
network will adapt itself to whatever is required regardless A physical neural network, however, is generally not 
of the initial state of the connections. Thus, as indicated at 40 digital. A physical neural network is a massively parallel 
block 1010, as the electric field is applied across the con- analog device. The fact that actual molecules (e.g., 
nection gap, the more the nonconductor(s) will align and the nanoconductors) must move around (in time) makes tern- 
stronger the connection becomes. Connections (i.e., P ora l summation a natural occurrence. This temporal sum- 
synapses) that are not used are dissolved back into the mation is built into the nanoconnections. The easiest way to 
solution, as illustrated at block 1012. As illustrated at block 45 understand this is to view the multiplicity of nanoconnec- 
1014, the resistance of the connection can be maintained or tions as one connection with one input into a neuron-like 
lowered by selective activations of the connections. In other node (Op-amp, Comparator, etc.). This can be seen in FIG. 
words, "if you do not use the connection, it will fade away," H- 

much like the connections between neurons in a human FIG. 11 illustrates a schematic diagram of a circuit 1100 

brain. 50 illustrating temporal summation within a neuron, in accor- 

The neurons in a human brain, although seemingly simple dance with a preferred embodiment of the present invention, 

when viewed individually, interact in a complicated network As indicated in FIG. 11, an input 1102 can be provided to a 

that computes with both space and time. The most basic nanoconnections 1104, which in turn can provide a signal, 

picture of a neuron, which is usually implemented in which can be input to an amplifier 1110 (e.g., op amp) at 

technology, is a summing device that adds up a signal. 55 node B. A resistor 1106 is connected to node A, which in turn 

Actually, this statement can be made even more general by is electrically equivalent to node B. Node B is connected to 

stating that a neuron adds up a signal in discrete units of a negative input of amplifier 1100. Resistor 1108 is also 

time. In other words, every group of signals incident upon connected to a ground 1108. Amplifier 1110 provides output 

the neuron can be viewed as occurring in one moment in 1114. Note that although nanoconnections 1104 is referred to 

time. Summation thus occurs in a spatial manner. The only 60 in the plural it can be appreciated that nanoconnections 1104 

difference between one signal and another signal depends on can comprise a single nanoconnection or a plurality of 

where such signals originate. Unfortunately, this type of data nanoconnections. For simplicity sake, however, the plural 

processing excludes a large range of dynamic, varying form is used to refer to nanoconnections 1104. 

situations that cannot necessarily be broken up into discrete Input 1102 can be provided by another physical neural 

units of time. 65 network (i.e., Knowm) to cause increased connection 

The example of speech recognition is a case in point. strength of nanoconnections 1104 over time. This input 

Speech occurs in the time domain. A word is understood as would most likely arrive in pulses, but could also be 
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continuous. A constant or pulsed electric field perpendicular ROM 1213 may store programs for carrying out the learning 

to the connections would serve to constantly erode the process according to error back-propagation for the physical 

connections, so that only signals of a desired length or neural network device or code rows concerning, for 

amplitude could cause a connection to form. Once the example, 80 kinds of phonemes for performing speech 

connection is formed, the voltage divider formed by nano- 5 recognition. The code rows concerning the phonemes can be 

connection 1104 and resistor 1106 can cause a voltage at utilized as second instructor signals and for recognizing 

node A in direct proportion to the strength of nanoconnec- phonemes from output signals of the neuron device network, 

lions 1104 When the voltage at node A reaches a desired ^ the RQM m3 can store ms of a transformation 

threshold, the amplifier (i.e., an op-amp and/or comparator), m for re izi h from rec0 gnized phonemes 

will output a high voltage (i.e., output 1114). The key to the 1Q and transformi the recognized speech into a writ ing (i.e., 

temporal summation is that just like a real neuron, it takes form) ented 5 characters . 

time tor the electric field to breakdown the nanoconnections , . , . t „ M 

1104, so that signals arriving close in time will contribute to J A predetermined program stored in the ROM 1213 can be 

the firing of the neuron (L., op-amp, comparator, etc.). downloaded and stored in the RAM 1214. RAM 1214 

Temporal summation has thus been achieved. The param- 1C generally functions as a random access memory used as a 

eters of the temporal summation could be adjusted by the 15 workm § memor y of the CPU 1211. In the RAM 1214 a 

amplitude and frequency of the input signals and the per- vector row storing area can be provided for temporarily 

pendicular electric field. storm § a P ower obtamed at each P oint m time for each 

i^t^ j • , 1 1 i j- mi . frequency of the speech signal analyzed by the FFT unit 

FIG. 12 depicts a block diagram illustrating a pattern a i * *u c u c 

*\ 1-1 i • < * V1 1221. A value or the power tor each frequency serves as a 

recognition system 1200, which may be implemented with on . * . . -\ j . t t 

..it ii- j zu vector row input to a first input portion of the physical neural 

a physical neural network device 1222, in accordance with , , . _ Al r . Al i , 

r .. u ,. . r +u . . ,. XT . network device 1222. Further, in the case where characters 

an alternative embodiment of the present invention. Note , . -j-.if.-i ^ 1 

+u . ... i^aa u • 1 , i or graphics are recognized in the physicaf neural network 

that pattern recognition system 1200 can be implemented as , . r ^ . , ° lt , • i- >±+**a 

r . * . \ _ u i -ii j • + u device, the image data read by the graphic reading unit 1224 

a speech recognition system. Ihose skilled in the art can t j • 4 l daw 111/ 

F , 6 nu i ^ u- are stored in the RAM 1214. 

appreciate, however, that although pattern recognition sys- 25 

tern 1200 is depicted herein in the context of speech The communication controi unit 1215 transmits and/or 
recognition, a physical neural network device (i.e., a receives various data such as recognized speech data to 
Knowm device) may be implemented with other pattern and/or from another communication control unit through a 
recognition systems, such as visual and/or imaging recog- communication network 1202 such as a telephone line 
nition systems. FIG. 12 thus does not comprise a limiting 30 network, an ISDN line, a LAN, or a personal computer 
feature of the present invention and is presented for general communication network. Network 1202 may also comprise, 
edification and illustrative purposes only. Those skilled in for example, a telecommunications network, such as a 
the art can appreciate that the diagram depicted in FIG. 12 wireless communications network. Communication hard- 
may be modified as new applications and hardware are ware methods and systems thereof are well known in the art. 
developed. The development or use of a pattern recognition 35 The printer 1216 can be provided with a laser printer, a 
system such as pattern recognition system 1200 of FIG. 12 bubble -type printer, a dot matrix printer, or the like, and 
by no means limits the scope of the physical neural network prints contents of input data or the recognized speech. The 
(i.e., Knowm) disclosed herein. display unit 1217 includes an image display portion such as 

FIG. 12 thus illustrates in block diagram fashion, the a CRT display or a liquid crystal display, and a display 

system structure of a speech recognition device using a 40 control portion. The display unit 1217 can display the 

neural network according to an alternative embodiment of contents of the input data or the recognized speech as well 

the present invention. The pattern recognition system 1200 as a direction of an operation required for speech recognition 

is provided with a CPU 1211 for performing the functions of utilizing a graphical user interface (GUI), 

inputting vector rows and instructor signals (vector rows) to The keyboard 1218 generally functions as an input unit 

an output layer for the learning process of a physical neural 45 for varying operating parameters or inputting setting condi- 

network device 1222, and changing connection weights tions of the FFT unit 1221, or for inputting sentences. The 

between respective neuron devices based on the learning keyboard 1218 is generally provided with a ten-key numeric 

process. Pattern recognition system 1200 can be imple- pad for inputting numerical figures, character keys for 

mented within the context of a data-processing system, such inputting characters, and function keys for performing vari- 

as, for example, a personal computer or personal digital 50 ous functions. A mouse 1219 can be connected to the 

assistant (PDA), both of which are well known in the art. keyboard 1218 and serves as a pointing device. 

The CPU 1211 can perform various processing and con- A speech input unit 1223, such as a microphone can be 

trolling functions, such as pattern recognition, including but connected to the FFT unit 1221. The FFT unit 1221 trans- 

not limited to speech and/or visual recognition based on the forms analog speech data input from the voice input unit 

output signals from the physical neural network device 55 1223 into digital data and carries out spectral analysis of the 

1222. The CPU 1211 is connected to a read-only memory digital data by discrete Fourier transformation. By perform- 

(ROM) 1213, a random-access memory (RAM) 1214, a ing a spectral analysis using the FFT unit 1221, the vector 

communication control unit 1215, a printer 1216, a display row based on the powers of the respective frequencies are 

unit 1217, a keyboard 1218, an FFT (fast Fourier transform) output at predetermined intervals of time. The FFT unit 1221 

unit 1221, a physical neural network device 1222 and a 60 performs an analysis of time-series vector rows, which 

graphic reading unit 1224 through a bus line 1220 such as a represent characteristics of the inputted speech. The vector 

data bus line. The bus line 1220 may comprise, for example, rows output by the EFT 1221 are stored in the vector row 

an ISA, EISA, or PCI bus. storing area in the RAM 1214. The graphic reading unit 224, 

The ROM 1213 is a read-only memory storing various provided with devices such as a CCD (Charged Coupled 

programs or data used by the CPU 1211 for performing 65 Device), can be used for reading images such as characters 

processing or controlling the learning process, and speech or graphics recorded on paper or the like. The image data 

recognition of the physical neural network device 1222. The read by the image-reading unit 1224 are stored in the RAM 
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1214. Note that an example of a pattern recognition a physical neural network is that it could handle the enor- 

apparatus, which may be modified for use with the physical mous network needed for such computations and adapt itself 

neural network of the present invention, is disclosed in U.S. in real-time. An example wherein a physical neural network 

Pat. No. 6,026,358 to Tomabechi, Feb. 16, 2000, "Neural (i.e., Knowm) can be particularly useful is the Personal 

Network, A Method of Learning of a Neural Network and 5 Digital Assistant (PDA). PDA's are well known in the art. A 

Phoneme Recognition Apparatus Utilizing a Neural Net- physical neural network applied to a PDA device can be 

work." It can be appreciated by those skilled in the art that advantageous because the physical neural network can ide- 

the Tomabechi reference does not teach, suggest or antici- ally function with a large network that could constantly 

pate the invention disclosed herein. The Tomabechi refer- adapt itself to the individual user without devouring too 

ence is discussed herein for illustrative, background general 1Q much computational time from the PDA. A physical neural 

edification purposes only and is not considered a limiting network could also be implemented in many industrial 

feature of the present invention. applications, such as developing a real-time systems control 

The implications of a physical neural network are tre- to the manufacture of various components. This systems 

mendous. With existing lithography technology, many elec- con * ro1 can be adaptable and totally tailored to the particular 

trodes in an array such as depicted in FIG. 5 can be etched a PP llcatlon > as necessarily it must. 

onto a wafer of silicon. The neurons (i.e., op-amps, diodes, The embodiments and examples set forth herein are 

etc.), as well as the training circuitry illustrated in FIG. 6, Presented to best explain the present invention and its 

11 1 1 •■», . -i- r n, 1 u practical application and to thereby enable those skilled in 

could be built onto the same silicon wafer, although it may f u . . ^\ , .« . * ^ , .„ - . 

, , . , , , , ^ A . 1 • j the art to make and utilize the invention. 1 nose skilled in the 

be desirable to have the connections on a separate chip due + u M1 +u + +u r •, . 

c , p art, however, will recognize that the foregoing description 

to the liquid solution or nanoconductors. A solution or on A 1 u u * j <? +u * 

H 20 and examples have been presented lor the purpose or 

suspended nanoconductors could be placed between the iii ustr ation and example only. Other variations and modifi- 

electrode connections and the chip could be packaged. The cations of me present invention will be apparent to those of 

resulting "chip" would look much like a current Integrated skill in the art? and it is the intent of the appended claims that 

Chip (IC) or VLSI (very large scale integrated) chips. One suc h variations and modifications be covered. The descrip- 

could also place a rather large network parallel with a 25 tion as set forth is not intended to be exhaustive or to limit 

computer processor as part of a larger system. Such a the scope of the invention. Many modifications and varia- 

network, or group of networks, could add significant com- tions are possible in light of the above teaching without 

putational capabilities to standard computers and associated departing from the scope of the following claims. It is 

interfaces. contemplated that the use of the present invention can 

For example, such a chip may be constructed utilizing a 30 involve components having different characteristics. It is 

standard computer processor in parallel with a large physical intended that the scope of the present invention be defined 

neural network or group of physical neural networks. A b Y the claims a PPended hereto, giving full cognizance to 

program can then be written such that the standard computer equivalents in all respects. 

teaches the neural network to read, or create an association The embodiments of an invention in which an exclusive 

between words, which is precisely the same sort of task in 35 P^perty or right is claimed are defined as follows: 

which neural networks can be implemented. Once the physi- 1 A physical neural network based on nanotechnology, 

cal neural network is able to read, it can be taught for said physical neural network comprising: 

example to "surf the Internet and find material of any at le ast one neuron-like node that sums at least one input 

particular nature. A search engine can then be developed that signal and generates at least one output signal based on 

does not search the Internet by "keywords", but instead by 40 a threshold associated with said at least one input 

meaning. This idea of an intelligent search engine has signal; and 

already been proposed for standard neural networks, but at least one connection network associated with said at 

until now has been impractical because the network required least one neuron-like node wherein said at least one 

was too big for a standard computer to simulate. The use of connection network comprises a plurality of intercon- 

a physical neural network (i.e., physical neural network) as 45 nected nanoconnections, such that each nanoconnec- 

disclosed herein now makes a truly intelligent search engine tion of said plurality of interconnected nanoconnec- 

possible. tions is strengthened or weakened according to an 

A physical neural network can be utilized in other application of an electric field, 

applications, such as, for example, speech recognition and 2. The physical neural network of claim 1 wherein said at 

synthesis, visual and image identification, management of 50 least one ° m P ut si § nal comprises a non-linear output signal 

distributed systems, self -driving cars and filtering. Such based on said threshold. 

applications have to some extent already been accomplished 3 - The physical network of claim 1 wherein said at least 

with standard neural networks, but are generally limited in one output signal comprises a linear output signal based on 

expense, practicality and not very adaptable once imple- said threshold. 

mented. The use of a physical neural network can permit 55 4 The physical neural network of claim 1 wherein said 

such applications to become more powerful and adaptable. threshold comprises a threshold below which said at least 

Indeed, anything that requires a bit more "intelligence" one output signal is not generated and above which said at 

could incorporate a physical neural network. One of the le ast one output signal is generated. 

primary advantages of a physical neural network is that such 5. The physical neural network of claim 1 wherein said at 

a device and applications thereof can be very inexpensive to 60 ^ eas ^ one connection network comprises: 

manufacture, even with present technology. The lithographic a number of layers of said nanoconnections; 

techniques required for fabricating the electrodes and chan- wherein said number of layers is equal to a number of 

nels therebetween has already been perfected and imple- desired outputs from said at least one connection net- 

mented in industry. work; and 

Most problems in which a neural network solution is 65 wherein said nanoconnections are formed without influ- 

implemented are complex adaptive problems, which change ence by disturbances resulting from other nanoconnec- 

in time. An example is weather prediction. The usefulness of tions thereof. 
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6. The physical neural network of claim 1 wherein at least 
one nanoconnection of said plurality of interconnected nano- 
connections comprises an electrically conducting material. 

7. The physical neural network of claim 6 wherein elec- 
trically conducting material is chosen such that a dipole is 5 
induced in said electrically conducting material in the pres- 
ence of an electric field. 

8. The physical neural network of claim 6 wherein said 
electrically conducting material comprises a chemically 
induced permanent dipole. 

9. The physical neural network of claim 1 wherein said at 
least one nanoconnection comprises at least one nanocon- 
ductor. 

10. The physical neural network of claim 9 wherein said 
at least one connection network comprises: 

at least one connection network structure having a con- 15 
nection gap formed therein; a solution located within 
said connection gap; 

wherein said solution comprises a solvent and said at least 
one nanoconductor; and 

wherein an electric field applied across said connection 20 
gap to permit an alignment of at least one nanocon- 
ductor within said connection gap. 

11. The physical neural network of claim 10 wherein said 
at is at least one nanoconductor is suspended in said solvent. 

12. The physical neural network of claim 10 wherein said 25 
at least one nanoconductor is located at a bottom of said 
connection gap. 

13. The physical neural network of claim 10 wherein an 
electrical conductance of said solution is less than an elec- 
trical conductance of said at least one nanoconductor within 30 
said solution. 

14. The physical neural network of claim 10 wherein a 
viscosity of said solution permits said at least one nanocon- 
ductor to move when said electric field is applied across said 
connection gap. 35 

15. The physical neural network of claim 10 wherein said 
at least one nanoconductor experiences an increased align- 
ment in accordance with an increase in said electric field 
applied across said connection gap. 

16. The physical neural network of claim 15 wherein 40 
nanoconnections of said at least one neuron-like node that 
are utilized most frequently by said at least one neuron-like 
node become stronger with each use thereof. 

17. The physical neural network of claim 16 wherein said 
nanoconnections that are utilized least frequently become 45 
increasingly weak and eventually become unaligned. 

18. The physical neural network of claim 16 wherein said 
at least one nanoconnection comprises a resistance, which is 
raised or lowered by a selective activation of said at least one 
nanoconnection. 50 

19. The physical neural network of claim 9 wherein said 
at least one nanoconductor comprises a nanowire. 

20. The physical neural network of claim 9 wherein said 
at least one nanoconductor comprises a nanotube. 

21. The physical neural network of claim 9 wherein said 55 
at least one nanoconductor comprises a plurality of nano- 

p articles. 

22. The physical neural network of claim 1 wherein at 
least one nanoconnection of said at least one connection 
network comprises a negative connection associated with 60 
said at least one neuron-like node. 

23. The physical neural network of claim 22 wherein said 
at least one connection network comprises: 

a number of layers of nanoconnections; 

wherein said number of layers is equal to a number of 65 
desired outputs from said at least one connection net- 
work; 



wherein said number of layers is equal to twice a number 
of desired outputs form said at least one connection 
network, if said nanoconnections comprise negative 
connections thereof; and 

wherein said nanoconnections are formed without influ- 
ence by disturbances resulting from other nanoconnec- 
tions thereof. 

24. A physical neural network apparatus based on 
nano technology, said physical neural apparatus comprising: 

at least one connection network associated with at least 
one neuron-like node wherein said at least one connec- 
tion network comprises a plurality of interconnected 
nanoconductors, such that each nanoconductor of said 
plurality of interconnected nanoconductors is strength- 
ened or weakened according to an application of an 
electric field; 

wherein each nanoconductor of said plurality of intercon- 
nected nanoconductors experiences an increase in 
alignment in accordance with an increase in said elec- 
tric field; 

wherein nanoconductors of said plurality of intercon- 
nected nanoconductors that are utilized most frequently 
by said at least one neuron-like node became stronger 
with each use thereof; and 

wherein nanoconductors of said plurality of intercon- 
nected nanoconductors that are utilized least frequently 
become increasingly weak and eventually become 
unaligned. 

25. The physical neural network apparatus of claim 24 
wherein said at least one neuron-like node sums at least one 
input signal and generates at least one output signal based on 
a threshold associated with said at least one input signal. 

26. The physical neural network of claim 24 wherein said 
at least one connection network comprises a plurality of 
layers, wherein a number of layers of said plurality of layers 
is equal to a desired number of outputs from said at least one 
connection network. 

27. A method for assembling a physical neural network 
based on nanotechnology, said method comprising the steps 
of: 

forming at least one neuron-like node that sums at least 
one input signal and generates at least one output signal 
based on a threshold associated with said at least one 
input signal; and 

configuring at least one connection network associated 
with said at least one neuron-like node wherein said at 
least one connection network comprises a plurality of 
interconnected nanoconnections, such that each nano- 
connection of said plurality of interconnected nanocon- 
nections is strengthened or weakened according to an 
application of an electric field. 

28. The method of claim 27 wherein said at least one 
output signal comprises a non-linear output signal based on 
said threshold. 

29. The method of claim 27 wherein said at least one 
output signal comprises a linear output signal based on said 
threshold. 

30. The method of claim 27 wherein said threshold 
comprises a threshold below which said at least one output 
signal is not generated and above which said at least one 
output signal is generated. 

31. The method of claim 27 further comprising the steps 
of: 

configuring said at least one connection network to com- 
prise a number of layers of said nanoconnections, 
wherein said number of layers is equal to a number of 
desired outputs from said at least one connection net- 
work; and 
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forming said nanoconnections without influence by dis- 
turbances resulting from other nanoconnections 
thereof. 

32. The method of claim 27 comprising the step of; 
forming at least one nanoconnection of said plurality of 5 
interconnected nanoconnections from an electrically con- 
ducting material. 

33. The method of claim 32 further comprising the step of: 
configuring said electrically conducting material such that a 
dipole is induced in said electrically conducting material in 10 
the presence of an electric field. 

34. The method of claim 32 comprising the step of: 
chemically inducing a permanent dipole within said electri- 
cally conducting material. 

35. The method of claim 27 wherein said at least one 15 
nanoconnection comprises at least one nanoconductor. 

36. The method of claim 35 further comprising the steps 

of: 

forming a connection gap from at least one connection 
network structure associated with said at least one 20 
connection network; 

locating a solution within said connection gap; configur- 
ing said solution to comprises a solvent and said at least 
one nanoconductor; and 

25 

applying an electric field across said connection gap to 
permit an alignment of at least one nanoconductor 
within said connection gap. 

37. The method of claim 36 further comprising the step of: 
suspending said at least one nanoconductor in said solvent. 3Q 

38. The method of claim 36 further comprising the step of: 
locating said at least one nanoconductor at a bottom of said 
connection gap. 

39. The method of claim 36 further comprising the step of: 
configuring said solution such that an electrical conductance 35 
of said solution is less than an electrical conductance of said 

at least one nanoconductor within said solution. 

40. The method of claim 36 further comprising the step of: 
configuring said solution to comprise a viscosity that permits 
said at least one nanoconductor to move when said electric 
field is applied across said connection gap. 

41. The method of claim 36 further comprising the step of: 
increasing an application of said electric field across said 
connection gap to thereby permit said at least one nanocon- 
ductor to experience an increased alignment in accordance 45 
with an increase in said electric field applied across said 
connection gap. 

42. The method of claim 41 wherein nanoconnections of 
said at least one neuron-like node that are utilized most 
frequently by said at least one neuron-like node become 
stronger with each use thereof. 

43. The method of claim 42 wherein said nanoconnections 
that are utilized least frequently become increasingly weak 
and eventually become unaligned. 

44. The method of claim 42 wherein said at least one 
nanoconnection comprises a resistance, which is raised or 
lowered by a selective activation of said at least one nano- 
connection. 
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45. The method of claim 35 further comprising the step of: 
configuring said at least one nanoconductor to comprise a 
nanowire. 

46. The method of claim 35 further comprising the step of: 
configuring said at least one nanoconductor to comprise a 
nanotube. 

47. The method of claim 35 further comprising the step of: 
configuring said at least one nanoconductor to comprise a 
plurality of nanoparticles. 

48. The method of claim 27 wherein at least one nano- 
connection of said at least one connection network com- 
prises a negative connection associated with said at least one 
neuron-like node. 

49. The method of claim 48 further comprising the step of: 
configuring said at least one connection network to com- 
prise a number of layers of nanoconnections, wherein 
said number of layers is equal to a number of desired 
outputs from said at least one connection network; 

wherein said number of layers is equal to twice a number 
of desired outputs form said at least one connection 
network, if said nanoconnections comprise negative 
connections thereof; and wherein said nanoconnections 
are formed without influence by disturbances resulting 
from other nanoconnections thereof. 

50. A method for assembling a physical neural network 
apparatus based on nanotechnology, said method comprising 
the steps of: 

forming at least one connection network associated with 
at least one neuron-like node wherein said at least one 
connection network comprises a plurality of intercon- 
nected nanoconductors, such that each nanoconductor 
of said plurality of interconnected nanoconductors is 
strengthened or weakened according to an application 
of an electric field; 

wherein each nanoconductor of said plurality of intercon- 
nected nanoconductors experiences an increase in 
alignment in accordance with an increase in said elec- 
tric field; wherein nanoconductors of said plurality of 
interconnected nanoconductors that are utilized most 
frequently by said at least one neuron-like node become 
stronger with each use thereof; and 

wherein nanoconductors of said plurality of intercon- 
nected nanoconductors that are utilized least frequently 
become increasingly weak and eventually become 
unaligned. 

51. The method apparatus of claim 50 further comprising 
the steps of: summing at least one input signal via said at 
least one neuron-like node; and generating at least one 
output signal based on a threshold associated with said at 
least one input signal. 

52. The method of claim 50 further comprising the step of: 
configuring said at least one connection network to comprise 
a plurality of layers, wherein a number of layers of said 
plurality of layers is equal to a desired number of outputs 
from said at least one connection network. 



